Readability index as a design criterion for elicited imitation tasks in automatic oral proficiency assessment
نویسندگان
چکیده
We investigate the effectiveness of using an accepted readability index, the Flesch Reading Ease (FRE) scale, to design prompts for an automatic oral proficiency assessment system. The prompts in question are uttered by the system, and must be repeated from memory by the test subjects, in the form of an elicited imitation exercise. The FRE scores for our prompts are shown to correlate well with the repeat accuracy ratings given to the same prompts by human judges. The prompts are also shown to perform well in the automatic assessment of oral proficiency by means of the elicited imitation tasks with more than one group of university students. We therefore conclude that a readability index, such as the FRE, can be used as a design criterion for prompts in an automated elicited imitation test.
منابع مشابه
Students’ Oral Assessment Considering Various Task Dimensions and Difficulty Factors
This study investigated students’ oral performance ability accounting for various oral analytical factors including fluency, lexical and structural complexity and accuracy with each subcategory. Accordingly, 20 raters scored the oral performances produced by 200 students and a quantitative design using a MANOVA test was used to investigate students’ score differences of various levels of langua...
متن کاملCombining elicited imitation and fluency features for oral proficiency measurement
The automatic grading of oral language tests has been the subject of much research in recent years. Several obstacles lie in the way of achieving this goal. Recent work suggests a testing technique called elicited imitation (EI) that can serve to accurately approximate global oral proficiency. This testing methodology, however, does not incorporate some fundamental aspects of language, such as ...
متن کاملEnglish and Non English major Teachers’ Assessment of Oral Proficiency: a case of Iranian Maritime English Learners
Speaking assessment is still construed as a complicated, under-researched process from the vantage point of tasks and rater characteristics. The present study aimed at investigating if and how English Major and none English Major teachers differ in their perception of the construct of oral proficiency while assessing learners’ L2 oral proficiency. To this end, 38 male and female non-native EFL...
متن کاملWhat Makes an Item Difficult? A Syntactic, Lexical, and Morphological Study of Elicited Imitation Test Items
Elicited imitation (EI) is an oral language testing method that has been experimented with since the 1960s. Its first uses were focused on assessing first language acquisition in children (Ervin-Tripp, 2001) and diagnosing language abnormalities (Berry, 1976; Lahey, Launer, & Schiff-Myers, 1983). Later, in the 1970s, researchers began to assess how useful the method would be within the field of...
متن کاملTheory and data in spoken language assessment
Spoken language performance depends on both psycholinguistic processing in the individual and on communicative uses of language in dialogue or discussion. A social-communication view of language emphasizes that the spoken form of a language is used in social settings to accomplish explicit or implicit tasks of many sorts. In testing, the communicative tradition is associated with oral proficien...
متن کامل